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We measure the correlation between the spin of the top quark and the spin of the anti-top quark 
in — >■ W^bW'h ^ t^vbl^ vh final states produced in pp collisions at a center of mass energy 
-^s = 1.96 TeV, where I is an electron or muon. The data correspond to an integrated luminosity of 
5.4 fb"^ and were collected with the DO detector at the Fermilab Tevatron collider. The correlation is 
extracted from the angles of the two leptons in the t and i rest frames, yielding a correlation strength 
C = 0.10lo'45, in agreement with the NLO QCD prediction within two standard deviations, but 
also in agreement with the no correlation hypothesis. 

PACS numbers; 14.65.Ha, 12.38.Qk, 13.85.Qk 



I. INTRODUCTION 



Measurements of top quark properties play an impor- 
tant role in testing the standard model (SM) and its pos- 
sible extensions. While top and anti-top quarks are un- 
polarized in ti production at hadron colliders, the ori- 
entation of their spins are correlated The SM also 
predicts that top quarks decay before the correlation be- 
tween the direction of the spin of the t and t quark can 
be affected by fragmentation [2] . This contrasts with the 
longer-lived lighter quarks, for which the spins become 
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decorrelated by strong interactions before they decay [1] . 
The orientation of the spin of the top quark is therefore 
reflected in its decay products. 

The charged leptons from the t Wh — > Ivib decays 
are the probes with the highest sensitivity to the direc- 
tion of the t quark spin (if not stated otherwise, charge 
conjugated states are implied through out the paper). 
Therefore the final state in which both W bosons from 
t quarks decay to leptons, referred to as dilepton final 
state, is ideal for measurements of the correlation be- 
tween the spins of pair-produced top and anti-top quarks 
and thus to test the SM 

The observation of spin correlation as expected in the 
SM would indicate that the top quark decays before the 
spin direction is affected by its fragmentation and there- 
fore provides an upper limit on the lifetime of the top 
quark. This can be related to the Cabibbo-Kobayashi- 
Maskawa matrix element Vtb without assumptions about 
the number of quark generations @. Scenarios beyond 
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the SM 0, [7l-[Tl| predict different production and decay 
dynamics for the top quark, which could affect the spin 
correlation. 

There is a recent measurement of tt spin correlation in 
semileptonic final states, in which one W boson decays 
to leptons and the other to quarks, by the CDF Collab- 
oration in 4.3 fb~^ of pp collisions at y/s = 1.96 TeV 
which agrees with the SM prediction. There is also an 
earlier measurement analyzing dilepton final states by 
the DO Collaboration using an integrated luminosity of 
125 pb"^ of colhsions at = 1.8 TeV fi^. However, 
the expected sensitivity of both previous measurements 
was not high enough to distinguish between a hypothe- 
sis of no correlation and the correlation predicted in the 
SM. In both measurements a different sign convention 
than the one in this article was used [l^ . 

In this letter, we measure the strength of the tt spin 
correlation C from a differential angular distribution in- 
volving the angles between the flight direction of the two 
decay leptons in the rest frames of their respective t 
quarks and the spin quantization axis (defined below). 
Top quarks are assumed to decay as predicted by the 
SM. We analyze the dilepton channels which correspond 
to decays of the W bosons (from t and i quark decays) 
into an electron and electron neutrino, a muon and a 
muon neutrino or a tau lepton and a tau neutrino if the 
tau decays leptonically. The analysis is performed using 
5.4 fb~^ of pp collisions at ^/s — 1.96 TeV collected with 
the DO detector at the Fermilab Tevatron collider. 

To reduce the dependence on the signal normalization, 
we extract the spin correlation simultaneously with the 
tt production cross section (cr^f). In the SM, CTj^ is pre- 
dicted to a precision of (6-8)% [15l - ll9l |. Many models of 
physics beyond the SM predict effects in the top quark 
sector that can affect both the top quark production rate 
and the spin correlation. For example, in supersymmetric 
models [20| , pair production of scalar top quarks decay- 
ing into a b quark, an electron or muon, and a scalar 
neutrino [2l| would affect the measured values of both 
(7(4 and C in dilepton final states. 



in |5| that an almost optimal choice of quantization axis is 
given by the direction of the beam. At tree level in quan- 
tum chromodynamics (QCD), C represents the number 
of events where the t and t spins are parallel minus the 
number of events where they are anti-parallel, normalized 
by the total number of events. The case of all spins being 
(anti-)parallel corresponds to C = 1 (C = —1), whereas 
an equal mixture of parallel and anti-parallel would give 
C = 0. Choosing the beam momentum vector as the 
quantization axis, C = 0.777j;Q Q42 is predicted at NLO 
in QCD This calculation uses the CTEQ6.1M parton 
distribution functions (PDF) with both the factorization 
and renormalization scale set to the top quark mass {nit). 
The uncertainty reflects the variation of this scale from 
nit/ 2 to 2mt- Figure [1] shows the cos 6*1 cos 6*2 distribu- 
tion calculated with spin correlation (C = 0.777) and 
without spin correlation (C = 0). A non- vanishing spin 
correlation leads to an asymmetry in the distribution. 
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FIG. 1: The distribution in cos0icos52 for a ti sample in- 
cluding the NLO QCD spin correlation (C = 0.777) (dashed 
line) and with no spin correlation (C = 0) (solid line) at the 
parton level, generated using mc@nlo [23 ]. 



II. OBSERVABLE 



The tt spin correlation strength C is obtained from the 
distribution Q 



1 



cPc 



1 



a d cos Old cos 02 4 



(1 — C cos 01 cos 6*2 



(1) 



where a denotes the cross section, and 9i and 6*2 are the 
angles between the direction of flight of the decay lep- 
tons and i~ in the t and t rest frames and the spin 
quantization axis [l^. These angles are chosen because 
the sensitivity to the spin correlation is largest when the 
decay products are down- type fermions 13 • C is a 
parameter between —1 and 1 that depends on the quan- 
tization axis used and determines the magnitude of the 
tt spin correlation. For the Tevatron, it has been shown 



III. DO DETECTOR 

The DO detector 24] contains a tracking system, a 
calorimeter, and a muon spectrometer. The tracking sys- 
tem consists of a silicon microstrip tracker (SMT) and 
a central fiber tracker, both located inside a 1.9 T su- 
perconducting solenoid. The design provides efficient 
charged-particle tracking in the pseudorapidity region 
hdetl < 3 [1^. The SMT provides the capability of recon- 
structing the pp interaction vertex (PV) with a precision 
of about 40 fim in the plane transverse to the beam di- 
rection and a determination of the impact parameter of 
any track relative to the PV [26] with a precision between 
20 and 50 /im, depending on the number of hits in the 



5 



SMT. The calorimeter has a central section (CC) cover- 
ing |?7dct| < 1-1 and two end calorimeters (EC) extending 
coverage to Ir/dotI ~ 4.2. The muon system surrounds 
the calorimeter and consists of three layers of tracking 
detectors and of scintillators covering |r7dct| < 2 '.27\. A 
1.8 T toroidal iron magnet is located outside the inner- 
most layer of the muon detector. The luminosity is cal- 
culated from the rate of pp inelastic collisions, measured 
with plastic scintillator arrays which are located in front 
of the EC cryostats. 

The DO trigger is based on a three-level pipeline sys- 
tem. The first level consists of hardware and firmware 
components, the second level combines information from 
different detectors to construct simple physical quanti- 
ties, while the software-based third level processes the 
full event information using simplified reconstruction al- 
gorithms dii. 



IV. EVENT SELECTION 

The selections for the ^£ (ee, e/i, and /i/i) decay chan- 
nels follow those described in Ref. [2^. Electrons are 
defined as clusters of calorimeter cells for which: (i) the 
energy deposited in the electromagnetic section of the 
calorimeter is > 90% of the total cluster energy, (ii) the 
energy is concentrated in a narrow cone and is isolated 
from other energy depositions, (iii) the spatial distribu- 
tion of the shower is compatible with that of an elec- 
tron and matches a track emanating from the PV. To 
further reduce background, we use the tracking system 
and calorimeter information to form a likelihood discrim- 
inant that enhances the efficiency to select real and to 
reject fake electrons. Electrons that fulfill criteria (i) 
to (iii) are referred to as "loose" electrons, while those 
that also fulfill the likelihood criterion are referred to as 
"tight" electrons. Both central (|?7det| < 1-1) and for- 
ward (1.5 < |?7det| < 2.5) electrons are considered in the 
analysis. 

Muons are defined using tracks reconstructed in the 
three layers of the muon system, with a matching track 
found in the central tracking system. To reduce back- 
ground, the sum of the track pT in a cone of size 
n = ^(Ay)2 (A0)2 = 0.5 around the muon axis 
must be < 15% of the muon pT- We also require the 
sum of calorimeter cell energies in an annulus of radius 
0.1 < AT?. < 0.4 relative to the axis of the muon track to 
be < 15% of the muon px- Muon candidates originating 
from top quark decays are required to have a distance of 
closest approach of the muon track with respect to the 
PV < 0.2 cm for a muon track without a hit in the SMT, 
and < 0.02 cm for a muon track with a hit in the SMT. 
Furthermore, muons must satisfy [rydetl < 2. 

Jets are reconstructed with a mid-point cone algo- 
rithm (s^l with radius TZ = 0.5. Jet energies are cor- 
rected for calorimeter response, additional energy from 
noise, pileup, and multiple pp interactions in the same 
bunch crossing, and out-of-cone shower development in 



the calorimeter. 

Jets are required to contain three or more tracks orig- 
inating from the PV within each jet cone. The high in- 
stantaneous luminosity achieved by the Tevatron leads 
to a significant background contribution from additional 
pp collisions within the same bunch crossing. The track 
requirement removes jets from such collisions and is only 
necessary for data taken after the initial 1 fb~^ data set. 
The missing transverse energy (^t) is defined by the 
magnitude and direction opposite to the vector sum of 
all significant transverse energies deposited in calorime- 
ter cells. The transverse energy of muons and corrections 
made to electron and jet energies are taken into account. 
A more detailed description of object reconstruction can 
be found in {31]. 

To select top quark pair events, we require two iso- 
lated, oppositely charged leptons with px > 15 GeV for 
all channels. At least two jets with px > 20 GeV and 
\r]dct\ < 2.5 are required. The final selection in the e/i 
channel requires that Ht (defined as the scalar sum of 
the leading lepton px and the px of each of the two most 
energetic jets) be greater than 110 GeV. This require- 
ment allows rejection of the largest backgrounds for this 
final state arising from Z/j* — > r+T~ and diboson pro- 
duction. To further reject Z/j* background, where l^x 
arises from mismeasurement, we compute for each ee and 
fj,fj, event a l^x significance likelihood based on the l^x 
probability distribution calculated from the l^x and the 
lepton and jet energy resolutions. We require this quan- 
tity to exceed 5. We find that only in the /i/x channel 
an additional cut on missing transverse energy is bene- 
ficial to increase the signal purity, and therefore require 
]^x > 40 GeV for /i/i final states. 



V. SIGNAL AND BACKGROUND MODELING 

Signal and background processes are modeled with 
a combination of Monte Carlo (MC) simulation and 
data. Top quark pair production is simulated using 
the MC@NLO generator assuming mt = 172.5 GeV. 
Events are processed through herwig (S^I to simulate 
fragmentation, hadronization and decays of short-lived 
particles. We generate tt MC samples both with and 
without the expected spin correlation, as both options 
are available in mc@nlo. To cross check, we also use 
the ALPGEN [3^ matrix-element generator interfaced to 
PYTHIA [sij to simulate parton showering. In all three 
cases events are processed through a full detector simula- 
tion using GEANT [3^ . The MC events are overlaid with 
data events from random bunch crossings to model the 
effects of detector noise and additional pp interactions. 
The same reconstruction programs are then applied to 
data and MC events. Lepton trigger and identification 
efficiencies as well as lepton momentum resolutions are 
derived from Z/'j* — )■ £~^i~ data. Jet reconstruction effi- 
ciencies and the jet resolutions are adjusted to the values 
measured in data, and l^x is recalculated accordingly. 
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Sources of background arise from the production of 
electroweak bosons that decay into charged leptons. In 
the ee, e^, and /x/i channels, the dominant backgrounds 
are Drell-Yan processes: (i) Zj^* — e"'"e~, (ii) Zj^* — 
r+T^ — > vt^vvl~v^ and (iii) Zj^* — > ii^ fi^ , and from 
diboson production (WW, WZ and ZZ) when the bo- 
son decays lead to two charged leptons in the final state. 
Other backgrounds can be attributed to jets mimicking 
electrons, muons from semileptonic decays of b quarks, 
in-flight decays of pious or kaons in a jet, and misrecon- 
structed ]^t- 

The selection efhciencies for the Z/j* background are 
estimated from MC samples generated by ALPGEN inter- 
faced with PYTHIA, while for diboson production they 
are estimated using pythia. The diboson processes are 
normalized to the next-to-leading order (NLO) inclusive 
cross section (36j . The Z/j* processes are normalized to 
the next-to-next-to-leading order (NNLO) inclusive cross 
section [s^] in the e/x channel. In the other two channels 
we normalize the MC expectation to the dilepton invari- 
ant mass distribution near the Z boson peak. The Z 
boson pT distribution predicted by ALPGEN is observed 
to agree poorly with the data, therefore a reweighting has 
been performed for samples of different jet multiplicities 
derived from Z — > e^e~ data events. 

Before making requirements on or its significance, 
the Z/^* background dominates in the ee and fifj, chan- 
nels. Although these events do not contain high-p^ neu- 
trinos, the Z/j* — i^£~ events can have large I^t from 
mismeasurement or poor resolution in ]^t- 

Two instrumental backgrounds are modeled using 
data. In the ee and efi channels, background from fake 
electrons arises from jets comprising an energetic ir^ or 
r] and an overlapping track. The contribution from this 
source of background is estimated by fitting to the ob- 
served distribution of an electron-likelihood discriminant 
in the data, as described in [sij. The dependence of the 
electron likelihood is determined for true electrons from 
a pure Z/j* data sample, while the electron likelihood 
for background is determined using a sample dominated 
by false electrons. In the e/i and /i/i channels, muons pro- 
duced in jets that fail to be reconstructed provide muons 
that appear isolated. We measure the fraction (/^) of 
muons that appear isolated using a dimuon control sam- 
ple dominated by false isolated muons. The contribution 
from events with misidentified isolated muons is given by 
the number of events in a like-sign dilepton sample (with- 
out imposing an isolation requirement) multiplied by the 
measured defined above. 



VI. RECONSTRUCTION OF EVENT 
KINEMATICS 

The calculation of the angular correlation described in 
Sec. im requires boosting the 4- momenta of the charged 
leptons back into the t or i quark rest frames. Every event 
must therefore be fully reconstructed. This is performed 



using the neutrino weighting method, devised originally 
for measuring nit in the dilepton channel [38]. The only 
difference in our procedure is that instead of calculating a 
weight distribution as a function of the hypothesized mj, 
we weight the distribution as a function of cos 0i cos 6*2 . 

In the dilepton final state, the momenta of the two 
charged leptons, two neutrinos, and two 6-quark jets are 
specified by eighteen components of momentum. We 
measure twelve of these from the observed leptons and 
jets. Four additional constraints are provided by requir- 
ing the two lepton- neutrino combinations to yield M\y, 
and the two Vl^-boson-f-6-jet combinations to yield rrit 
(which we assume to be 172.5 GeV for t and t). Two ad- 
ditional quantities must be specified to fully reconstruct 
the event kinematics. 

To obtain the two missing quantities, we sample the 
pseudorapidity distributions 771 and 772 for the two neu- 
trinos into ten bins each using ti MC. These distributions 
are found to be independent of tt spin correlation. The 
bin ranges are chosen in steps of equal probability. We 
use the median of each bin to resolve the kinematics of 
the event, with up to two solutions for each of the neu- 
trino transverse momenta. 

The measured value of the I^t is then used to assign a 
weight w to each of the solutions for each assumed set of 
rj values; specifically, for a given 771 and 772, we calculate 
the l^T in the reconstructed event and compare it to the 
measured I^t as follows: 



w = exp 



f TP TP \ ^ ^ f TP ^"''^ TP 

yjpx - Jpxj + yPy ~ tpy 



, (2) 



where <^ jj]^ is the resolution of the x component of the 

(taken to be the same as that on the y component) [ssj . 
This assigns a higher weight (w) to r/1.2 pairs that are 
consistent with the observed TfiT- 

Since it is not possible to unambiguously associate a 
jet to the correct top quark, all combinations are tried. 
This increases the possible number of solutions per event 
from four to eight. 

Detector resolutions are accommodated in the weight 
calculation as follows. For each configuration of a MC 
event, we simulate the effect of the detector resolution 
by repeating the calculation 150 times with the measured 
jet and lepton momenta smeared independently accord- 
ing to the detector response. The resolutions in lepton 
energies are assumed to be Gaussian and the resolution of 
the jets is modeled using the sum of two Gaussian distri- 
butions [111. The 150 resolution-smeared weights are av- 
eraged, therefore smoothing the weight distribution of an 
event. This number provides stable and smooth weight 
distributions, with acceptable computation times. For 
data, the number of smearings is increased to 1000 to en- 
sure that the result does not depend on statistical fluctu- 
ations of the smearing. Events without any solution are 
ignored in the analysis. The probabilities that the re- 
construction of the full event kinematics provides a valid 
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TABLE 1: Probability that the neutrino weighting procedure 
yields a valid solution for diflterent classes of events. The Z — > 
rr, Z — >■ /i/i and Z — > ee backgrounds are shown combined, 
as are the diboson and instrumental backgrounds. In the last 
column we give the value observed in data. The statistical 
uncertainties are « 1%. 

tt Z Diboson Instrumental Total Observed 
0.96 0.82 0.90 0.82 0.92 0.91 



buttons from backgrounds, as a function of cos^i cos02- 
As the ratio of signal to background is different in ee, 
e\i and final states, we analyze each channel sepa- 
rately. In each channel, we use eight bins of equal size 
over the range [—0.4,0.4], and additionally one bin each 
for the range [—1, —0.4] and [0.4, 1]. The cos^i 008 6*2 dis- 
tributions in data are compared with these templates to 
extract the best measured value for C (Cmoas)- 



solution for tt and background events are given in Ta- 
ble [T] Table [5] summarizes the predicted background and 
the observed number of events in data, together with the 
number of expected tt events using the tt cross section 
measured in this analysis. For each event with a solution 
the w distribution is normalized to unity, and the mean 
of the w distribution is used as estimator for the true 
value of cos d\ cos 6*2 . The correlation coefRcient between 
our estimator and the true value of cos d\ cos is about 
0.5. 



VII. TEMPLATES 

Templates of the cos B\ cos Q2 distributions are gener- 
ated using MC events for different values of C and then 
compared to data. Figure [2] shows the distribution for 
cos ^1 cos 6*2 for background, tt signal with NLO QCD 
spin correlation, and the prediction for tt signal without 
spin correlation. Different fractions of events without and 



200 




-1 -0.5 0.5 1 



COS 9^ cos 82 

FIG. 2: (Color online) The distribution in cos 61 cos6'2 for the 
entire dilepton event sample. The summed tt signal, including 
NLO QCD spin correlation (C = 0.777) (red) and all back- 
grounds (blue) are compared to data. The open histogram is 
the tt prediction without spin correlation (C = 0) . The slight 
asymmetry in the cos Q\ cos Q2 distribution does not bias the 
measurement. 

with SM spin correlation can be used to generate tt sam- 
ples of different true values of C . Templates are formed 
from the sum of tt signals of different C values and contri- 



VIII. FIT TO TEMPLATES AND SYSTEMATIC 
UNCERTAINTIES 

We perform a binned maximum likelihood fit to extract 
the measured value Cmoas- We maximize the likelihood 
function 

K 

/: = n^'(«^.™0 X n^K;0'SDfc), (3) 

i k=l 

where V{n,m) represents the Poisson probability to ob- 
serve n events when m events are expected. The first 
product runs over all the bins i of the templates of all 
channels. Systematic uncertainties are taken into ac- 
count by parameters Vk, where each independent source 
of systematic uncertainty k is modeled as a Gaussian 
probability density function, Q (v; 0, SD), with zero mean 
and width corresponding to one standard deviation (SD) 
in the uncertainty of that parameter. Correlations among 
systematic uncertainties between channels are taken into 
account by using the same parameter for the same sources 
of uncertainty. The predicted number of events in each 
bin is the sum of the predicted number of background 
and expected tt events and depends on C. 

We consider both systematic uncertainties which af- 
fect only normalization factors and those which alter 
the differential distribution of cos 9i cos 02- Uncertainties 
derived from differences between data and MC for the 
jet energy scale, jet energy resolution, jet identification, 
and from theoretical uncertainties on PDFs, background 
modeling, and the choice of mt are taken as differential in 
cos 9i cos 6*2 . Systematic uncertainties affecting the over- 
all signal efhciency and the normalization of backgrounds 
include lepton identification, trigger requirements, uncer- 
tainties on the normalization of background, the uncer- 
tainty on the luminosity, MC modeling, and the determi- 
nation of instrumental background. We also include an 
uncertainty on the templates because of limited statis- 
tics in the MC samples. We estimate the latter from 
1000 pseudo-experiments, where we randomly vary each 
bin in the templates within the statistical uncertainty of 
the MC and repeat the measurement on data. 

The statistical and systematic uncertainties on Cmcas 
are listed in Table [31 We evaluate the size of the in- 
dividual sources of systematic uncertainty by setting all 
parameters for the systematic uncertainties to their fit- 
ted mean value and calculate the impact of the upward 
and downward one standard deviation uncertainty on the 
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TABLE 2: Yields for events with a solution in the neutrino weighting procedure. The number of 
tt events is calculated using au — 7.92 pb as measured in this analysis. The Z — >■ tt, Z — >■ fifi, 
and Z ^ ee backgrounds are shown combined, as are the different instrumental backgrounds. 
Uncertainties include statistical and systematic contributions. 

tt Z Diboson Instrumental Expected Observed 
Number of events 324j:^| 75tll ^7-1 '^^tj 439±i^^ 44f 



fitted parameter on the measured quantities Cmcas and 
IX. RESULT 




meas 



FIG. 3: (Color online) The 68% (inner), 95% (middle), and 
99% (outer) C.L. bands of C as a function of Cmoas from 
likelihood fits to MC events for all channels combined. The 
yellow line indicates the most probable value of C as a func- 
tion of Cmcas, and represents the calibration of the method. 
The vertical dashed black line depicts the measured value 
Cmoas ~ 0.10. The horizontal band indicates the NLO QCD 
prediction of C = 0.777^^42- 



of Cmoas by using Fig. [3l For the SM expectation of 
C — 0.777 we expect to exclude values below —0.06 at 
the 95% C.L. From the maximum likelihood fit to data 
we obtain Cmcas = 0.101q44 (stat+syst), which is shown 
in Fig. |3l We transform Cmoas into 

C = O.lOtoil (stat+syst) , (4) 

and extract a 95% C.L. region of probability for C as 
[—0.66,0.81]. Our result is within two standard devia- 
tions of the NLO QCD prediction of C = 0.777;^ |^42 but 
also compatible with the no-correlation hypothesis. 

The simultaneously extracted tt cross section is found 
to be 

att = imtl ^gl (stat + syst) pb (5) 

for nit — 172.5 GeV, which agrees with the SM prediction 
ofa,,- = 7.46j:^f7 pb 0. 



X. CONCLUSION 

We have measured the spin correlation between top 
and anti-top quarks in ti production using a differential 
angular distribution in lepton decay angles. The correla- 
tion coefficient characterizing the degree of spin correla- 
tion is found to be C = 0.10l^;4^. This is the most precise 
result obtained from the analysis of top quark pair pro- 
duction in dilepton final states. Since the measured value 
of C agrees with the SM prediction of C = 0.777lJ^{!4^ 
in NLO QCD within two standard deviations, there is no 
significant hint for anomalous production or decay of top 
quark pairs. 
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TABLE 3: Summary of uncertainties on Ci 



Source 


+SD 


-SD 


Muon identification 


0.01 
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Electron identification and smearing 


0.01 


-0.01 


PDF 


0.02 


-0.01 


Top Mass 


0.01 


-0.01 


Triggers 


0.02 


-0.02 


Opposite charge requirement 


0.00 


-0.00 


Jet energy scale 


0.01 


-0.01 


Jet reconstruction and identification 


0.06 


-0.06 


Normalization 


0.02 


-0.02 


Monte Carlo statistics 


0.02 


-0.02 


Instrumental background 


0.00 


-0.00 


Background Model for Spin 


0.03 


-0.04 


Luminosity 


0.03 


-0.03 


Other 


0.01 


-0.01 


Template statistics for template fits 


0.07 


-0.07 


Total systematic uncertainty 


0.11 


-0.11 


Statistical uncertainty 


0.38 


-0.40 
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